Language Model Priming for Cross-Lingual Event Extraction
نویسندگان
چکیده
We present a novel, language-agnostic approach to "priming" language models for the task of event extraction, providing particularly effective performance in low-resource and zero-shot cross-lingual settings. With priming, we augment input transformer stack's model differently depending on question(s) being asked at runtime. For instance, if is identify arguments trigger "protested", will provide that as part model, allowing it produce different representations candidate than when about "arrest" elsewhere same sentence. show by enabling better compensate deficits sparse noisy training data, our improves both argument detection classification significantly over state art setting.
منابع مشابه
Cross-Lingual Phonological Priming 1 Running head: CROSS-LINGUAL PHONOLOGICAL PRIMING The Size of the Cross-Lingual Masked Phonological Priming Effect Does Not Depend on Second Language Proficiency
Using a masked phonological priming paradigm, Brysbaert, Van Dyck and Van de Poel (1999) showed that Dutch-French bilinguals perform better at identifying tachistoscopically presented L2 words (e.g. oui [yes]) when those words are primed by L1 words or nonwords that are homophonic to the L2 target word according to the L1 grapheme-phoneme conversion rules (e.g. wie [who]). They noted that this ...
متن کاملCAREER: Cross-document Cross-lingual Event Extraction and Tracking
Information Extraction (IE) is a task of identifying 'facts' (entities, relations and events) within unstruc-tured documents, and converting them into structured representations (e.g. databases). Most current IE systems focus on processing single documents and the result are many unconnected, unranked, redundant (and some erroneous) facts. The research objective of this proposal is to define se...
متن کاملCross-Lingual Event Tracking
Cross-lingual event tracking from a very large number of information sources (thousands of Web sites, for example) is an open challenge. In this paper we investigate effective and scalable solutions for this problem, focusing on the use of cross-lingual information retrieval techniques to translate a small subset of the training documents, as an alternative to the conventional approach of trans...
متن کاملLanguage model adaptation using cross-lingual information
The success of statistical language modeling techniques is crucially dependent on the availability of a large amount training text. For a language in which such large text collections are not available, methods have recently been proposed to take advantage of a resource-rich language, together with cross-lingual information retrieval and machine translation, to sharpen language models for the r...
متن کاملCross-lingual sentence extraction for information distillation
Information distillation aims to analyze and interpret large volumes of speech and text archives in multiple languages and produce structured information of interest to the user. In this work, we investigate cross-lingual information distillation, where nonEnglish (source language) documents are searched for user queries that are in English (target language). We propose to perform distillation ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2022
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v36i10.21307